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SPECIFICATION  AND  MEASUREMENT 
OF  FREQUENCY  STABILITY 

John  H.  Shoaf 

Atomic  Frequency  and  Time  Standards  Section 
National  Bureau  of  Standards 
Boulder,  Colorado    80302  USA 

Abstract 

This  report  gives  concise  definitions  for  specifying 
frequency  stability  for  measurements  in  the  frequency 
domain  and  tim.e  domain.    Standards  of  terminology  and 
of  measurement  techniques  are  r ecoromended.  Measure- 
ment systems  are  described  in  adequate  detail  so  that  the 
apparatus  may  be  duplicated.     Proposed  extension  of  the 
measurement  systems  through  12.4  GHz  is  discussed. 

Key  Words:    Allan  variance ,  Frequency  stability 

measurements,  Measurement  system 
description,  Phase  noise,  Spectral  density, 
Terminology  standards. 

1.    INTRODUCTION  AND  BACKGROUND 

At  the  beginning  of  FY  71  the  Department  of  Defense  Joint 
Services  Calibration  Coordinating  Group  (DoD/CCG),  Ray  Y,  Bailey 
(Chairman),  Newark  Air  Force  Station,  Newark,   Ohio,  initiated  a 
proposal  with  the  National  Bureau  of  Standards  (NBS)  to  write  a  survey 
paper  pertaining  to  the  specification  and  measurement  of  frequency 
stability.    The  project  was  under  the  jurisdiction  of  the  DoD/CCG  Time 
and  Frequency  Working  Group.     The  members  of  this  group  are  E.  L. 
Kirkpatrick  (Chairman),  Aerospace  Guidance  and  Metrology  Center, 


Newark  Air  Force  Station,  Newark,  Ohio;  Lloyd  H.  Daniels,  U,  S. 
Army  Metrology  and  Calibration  Center,  Redstone  Arsenal,  Alabama; 
and  Peter  Strucker,  Metrology  Engineering  Center,  Pomona,  California. 

A  widely-accepted,  well-defined  set  of  standards  for  the 
specification  and  measurement  of  frequency  stability  has  been  long 
overdue.    A  manuscript  by  the  Institute  of  Electrical  and  Electronics 
Engineers  Subcommittee  on  Frequency  Stability  appears  to  be  the  most 
comprehensive  treatment  of  the  subject  to  date.    The  manuscript  [1], 
"Characterization  of  Frequency  Stability"  by  Barnes  et  al.  ,  may  be 
considered  an  authoritative  paper  on  the  subject;  it  has  been  used 
extensively  in  the  preparation  of  this  survey  report. 

This  report  gives  recommended  standards  of  terminology  and 
measurement  techniques  in  addition  to  comparison  of  other  widely  used 
contemporary  measurement  methods  for  determination  of  frequency 
stability.     Operational  systems  for  frequency  stability  measurement  at 
the  National  Bureau  of  Standards  are  described  in  detail  and  extension 
of  these  systems  to  12.4  GHz  is  discussed.    An  extensive  bibliography 
on  frequency  measurement  is  also  included. 

A  comprehensive  knowledge  of  the  definitions  and  relations 
outlined  below  is  necessary  in  order  to  understand  the  practical  systems 
that  are  useful  for  measurement  of  frequency  stability.     It  is  the  objec- 
tive in  this  report  to  place  the  emphasis  on  details  of  useful  working 
systems  (apparatus)  that  may  be  duplicated  by  others  in  the  field  of 
frequency  stability  measurements.     Uniformity  of  data  presentation  is 
recommended  to  facilitate  interpretation  of  stability  specifications  and 
to  enable  one  to  communicate  and  compare  experimental  results  more 
readily. 

Experience  in  the  use  of  these  measurement  systems  and  these 
concepts  will  be  the  best  teacher;  this  report  is  at  most  the  teacher's 
as  sistant. 
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2.    TERMINOLOGY  FOR  SPECIFICATION 
OF  FREQUENCY  STABILITY 

A  general  definition  of  frequency  stability  has  been  stated  as 
"the  degree  to  which  a  signal  source  (e.  g„  ,  oscillator)  produces  the 
same  value  of  frequency  throughout  a  specified  period  of  time,  " 
Measurement  of  stability  can  be  accomplished  in  both  the  frequency 
domain  (e,  g.  ,   spectrum  analysis)  and  the  time  domain  (e.  g.  ,  gated 
frequency  counter).    In  the  aforementioned  manuscript  [1]  the  authors 
chose  to  use  two  independent  definitions,  each  related  to  different, 
useful  methods  of  measurement.     In  addition  to  the  following  comments 
on  definitions,   a  complete  glossary  of  symbols  for  this  paper  is  found 
in  Appendix  A. 

The  first  definition  of  frequency  stability  (frequency  domain)  is 
the  one-sided  spectral  density  of  the  fractional  frequency  fluctuations, 
y,  on  a  per  hertz  basis: 

S  (f)  H   spectral  density  of  y,  (1) 

y 


where  y  represents  the  fractional  frequency  fluctuations,    y  =  bv/^ 


o 


This  measure  of  stability  has  the  dimensions  of  inverse  hertz.  The 
spectral  density  of  phase  fluctuations  is  related  by  the  identity, 


S.^(f)      S  (f) 
O'i  y 


2, ,2 
V  /f 
o 


The  second  definition  of  frequency  stability  (time  domain)  uses 
the  type  of  sample  variances  called  the  Allan  variance   [2]  of  y: 

n=l  k=l 

This  measure  of  stability  is  dimensionles  s .     The  bar  over  the  y  indicates 
that  y  has  been  averaged  over  a  time  interval  T.     The  angular  brackets 
indicate  an  average  of  the  quantity  over  time. 
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Further  explanation  of  these  definitions  will  be  given  later. 
A  very  coraplete  discussion  may  be  found  in  reference  [1]. 

Frequency  drift  is  defined  as  a  systematic,  typically  linear 
increase  or  decrease  of  frequency  with  time.     This  is  characterized  as 
"aging  rate"  in  crystal  oscillators  and  is  expressed  in  fractional  parts 
per  period  of  time.     This  report  on  frequency  stability  does  not  include 
a  discussion  of  this  so-called  "linear  drift.  " 

In  all  known  signal  sources  the  output  frequency  is  affected  by 
noises  of  various  types.     The  noises  can  be  characterized  by  their  fre- 
quency dependence.     The  random  noises   [1]  include  white  thermal  and 
shot  noises  (f°),  flicker  noise   (f  and  integrals  of  these  noises. 

It  is  the  examination  of  these  noise  spectra  with  which  we  are  concerned 
in  the  first  definition  of  frequency  stability  given  in  eq  (1).    The  frac- 
tional frequency  fluctuation  spectral  density  S  (f)  is  not  to  be  confused 

with  the  radio  frequency  power  spectral  density  S      (v)  which  is  not  a 
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good  primary  measure  of  frequency  stability  because  of  fluctuations  in 
amplitude  and  for  other  reasons  [1]. 

Since  S   (f)   of  eq  (1)  is  expressed  in  terms  of  the  spectral  density 
of  phase  fluctuations  S     (f ) ,  a  convenient  laboratory  method  of  deter- 
mining  the  phase  noise  would  be  useful.     Phase  noise  spectral  density 
plots  are  used  for  presenting  frequency  stability  information  in  the 
frequency  domain. 

Script  5£(f)  is  a  frequency  domain  measure  of  phase  fluctuations 
(noise,  instability,  modulation)  used  at  NBS.     Script  a?(f)  is  defined  as 
the  ratio  of  the  power  in  one  phase  noise  sideband,   referred  to  the 
input  carrier  frequency,  on  a  per  hertz  of  bandwidth  spectral  density 
basis,  to  the  total  signal  power,   at  Fourier  frequency  f  from  the 
carrier,  per  one  device. 
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^(f)  = 


Power  density  (one  phase  modulation  sideband) 
Power  (total  signal) 


(3) 


For  small  §0, 


m  =   2=£(f)  .  (4) 


A  practical  system  for  the  measurement  of  s£(f)  or  Sg^(f)  will  be 
described  in  detail  later. 

2 

In  the  time  domain  a  useful  determination  of    (ct^  (N,  T,T))  of  eq  (2) 
may  be  accomplished  by  utilization  of  the  particular  Allan  variance  [2] 
where  specifically  N  =  2  and  T  =  T  such  that 

a^T)  .  /a  (N=2,T=T,  T))=  <  ^     ).  (5) 

y  y  2 

Plots  of  CT  versus   T  on  a  log-log  scale  are  commonly  used  as  a 
presentation  of  frequency  stability  in  the  time  domain.  Convenient 
suitable  systems  and  techniques  used  at  NBS  for  obtaining  time  domain 
measurements  of  frequency  stability  will  be  discussed  extensively  later. 
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3.    COMPARISON  OF  MEASUREMENT  TECHNIQUES 

In  this  discussion  we  shall  not  concern  ourselves  with  accuracy 
of  a  frequency.    The  primary  concern  shall  be  the  measurement  of 
fluctuations  of  frequency,  i.  e.  ,  instability  or  stability.    It  is  sometimes 
convenient  to  refer  to  the  instability  as  fractional  frequency  deviation. 

The  measurement  of  frequency  fluctuations  can  be  accomplished 
by  one  or  more  of  several  methods.    In  each  method  a  precise  (stable 
in  time)  reference  is  essential.    In  the  case  of  measuring  excellent 
sources  an  equally  excellent  reference  source  is  needed. 

The  first  method,  direct  counting  of  frequency  by  the  use  of 
counters ,  is  straightforward.    Here,   successive  values  of  frequency 
are  read  out  directly  and  recorded.     (The  reference  signal  controls  the 
counter  gate.  )    Statistical  analysis  of  the  results  are  usually  made. 
High  resolution  is  not  possible  by  this  method  when  measuring  the  lower 
frequencies  unless  frequency  multiplication  is  used.    Two  disadvantages 
of  frequency  multipliers  are- -one,  a  pair  of  specialized  multiplier 
chains  may  be  needed  for  each  different  carrier  frequency  range  and, 
two,  not  only  does  the  signal  noise  get  multiplied  but  noise  from  the 
multiplier  itself  may  be  introduced. 

A  second  method  involves  mixing  the  two  frequencies  and 
recording  the  beat.    When  the  reference  and  signal  frequencies  are 
close  in  value,  this  requires  determination  of  the  fluctuations  in  very 
long  beat  periods.     A  quantitative  measure  of  short-term  frequency 
stability  is  not  practical  in  this  case.    However,  when  a  large  offset 
frequency  is  introduced,  the  method  is  feasible  for  assessing  stability 
when  a  readout  device  such  as  a  period  counter  is  used  for  observing 
fluctuations  in  the  period  of  the  beat. 
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A  somewhat  similar  method  uses  a  phase  sensitive  detector  for 
determining  phase  fluctuations  between  two  signals  which  are  approx- 
imately in  phase  quadrature  (and  hence  must  be  at  the  same  frequency). 
Short-term  (or  long-term)  phase  fluctuations  may  be  recorded.  In 
order  to  facilitate  statistical  analysis  it  is  advantageous  to  drive  an 
analog-to-digital  converter  and  a  counter  with  a  printer.    This  method 
is  related  to  the  NBS  system  (time  domain)  which  is  described  in  detail 
in  Section  4. 

An  interesting  and  fast  method  used  for  comparison  of 
frequencies  and  also  applicable  to  stability  measurement  (time  domain) 
is  the  commercially  available  frequency  error  expander.    Since  fre- 
quency multiplication  is  used,  the  same  disadvantages  are  present  as  in 
the  first  method  where  multipliers  are  employed.    The  principle  of  the 
error  expander  is  that  one  of  the  signals  is  synthesized  to  a  convenient 
offset  frequency  which  is  then  mixed  and  multiplied  in  stages  to  obtain 
higher  and  higher  resolution.    Eventually,  however,  the  region  is 
reached  where  the  noise  becomes  very  great  and  frequency  comparison 
is  no  longer  possible. 

It  is  noted  that  none  of  the  above-mentioned  conventional  methods 
of  measuring  frequency  stability  utilize  frequency  domain  techniques. 
As  indicated  previously,  in  order  to  have  a  comprehensive  and  sufficient 
measure  of  frequency  stability  it  is  preferred  that  the  measurements 
involve  both  frequency  and  time  domain  techniques.    This  is  recom- 
mended even  though  it  is  possible  to  compute  time  domain  performance 
from  frequency  domain  results  and  often  conversely  [1].    Appendix  D 
contains  a  table  which  allows  translation  from  one  domain  to  the  other. 
At  least  one  man\xfacturer  has  made  it  convenient  to  determine  frequency 
stability  in  the  time  domain  with  the  results  computed  automatically  [3],  [4]. 
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others  outside  NBS  have  reported  on  excellent  systems  for  frequency- 
domain  and  for  time  domain  measurements  of  frequency  stability  [5], 
[6],  [7],  [8].    Some  of  these  resemble  in  principle  the  systems  used  at 
NBS.    The  techniques  described  by  Van  Duzer  [5]  and  Meyer  [6]  best 
describe  those  used  in  the  NBS  systems. 

Fortunately,  frequency  domain  and  time  domain  methods  for 
measuring  frequency  stability  require  similar  apparatus  except  that: 
to  make  measurements  in  the  frequency  domain  you  must  have  a 
frequency  window  (spectrum  analyzer)  following  the  detector;  for  the 
time  domain  you  must  have  a  time  window  (gated  counter)  following  the 
detector.  . 
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4.    OPERATIONAL  SYSTEMS  FOR  MEASUREMENT 
OF  FREQUENCY  STABILITY  AT  NBS 

It  was  the  introduction  of  good  double -balanced  mixers  that 
permitted  measurement  of  frequency  stability  by  improved  techniques. 
The  double -balanced  mixer,  considered  as  a  phase  sensitive  detector, 
makes  possible  meaningful  frequency  stability  measurements  of 
high-quality  signal  sources  in  both  the  frequency  domain  and  the  time 
domain.    The  results  are  quantitative  and  may  be  obtained  from  a 
measurement  system  which  is  reasonable  in  cost. 

The  frequency  stability  measurement  systems  described  below 
have  been  used  at  NBS  since  1967.    The  functional  block  diagrams  in 
figures  1,  7,  and  9  are  referred  to  in  the  detailed  descriptions  of  the 
particular  systems.    Certain  commercial  components  utilized  in  the 
systems  are  referred  to  by  brand  name  and  model  number.  *  Substitute 
components  with  similar  specifications  will  give  equivalent  results. 


Certain  commercial  equipment,  instruments,  or  materials  are 
identified  in  this  paper  in  order  to  adequately  specify  the  experimental 
procedure.    In  no  case  does  such  identification  imply  recommendation 
or  endorsement  by  the  National  Bureau  of  Standards,  nor  does  it 
imply  that  the  material  or  equipment  identified  is  necessarily  the  best 
available  for  the  purpose. 
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FIGURE  1:    FREQUENCY  DOMAIN  MEASUREMENT  OF  FREQUENCY  STABILITY 

( 1 )  OSCILLATOR  UNDER  TEST 

(2)  REFERENCE  OSCILLATOR  OF  HIGH  SPECTRAL  PURITY   (VARACTOR  TUNING) 

(3)  ADJUSTABLE  ATTENUATOR   (TYPICALLY  lOdB) 

(4)  DOUBLE-BALANCED  MIXER,   HP  MODEL   10514A    (SCHOTTKY   BARRIER  DIODES) 

(5)  NBS   LOW-NOISE  dc   AMPLIFIER   (SEE   FIGURE  3) 

(6)  OPERATIONAL  AMPLIFIER,   PHILBRICK  MODEL  P65AU  OR  P25AU   (SEE  FIGURE  2' 

(7)  BATTERY   BIAS   BOX    (SEE   FIGURE  5) 

(8)  SPECTRUM  ANALYZER,   QUAN-TECH  MODEL  304 


Figure  1  illustrates  the  measurement  system  typically  used 
at  NBS  for  frequency  domain  measurements.     It  should  be  noted  that 
time  domain  data  can  also  be  obtained  simultaneously,   although  usually 
this  system  is  used  only  for  frequency  domain  measurements.  (For 
tinie  domain  measurements  it  is  often  more  convenient  to  use  a  slightly 
modified  measurement  setup  to  be  described  later,  i    In  this  freqLiency 
domain  setup  the  oscillator  under  test  is  fed  into  one  side  of  a  low-noise 
double  -  balanc  ed  mixer  (HP  Model  105  14A),  which  utilizes  Schottky 
barrier  diodes.     The  reference  oscillator  is  fed  into  the  other  side  of 
the  mixer  through  an  attenuator,  typicallv  10  dB.     The  mixer  acts  as 
a  phase  sensitive  detector  so  that  when  the  two  signals  are  ifU.ntical  m 
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frequency  and  are  in  phase  quadrature  the  output  is  approximately  zero 
volts  dc .     When  this  output  is  sent  back  to  the  reference  oscillator  via 
the  varactor  tuning,  phase  lock  is  achieved.     The  phase  lock  loop  con- 
tains proper  terraination  at  theoutput  of  the  mixer  follov^^ed  by  operational 
amplifiers  v/ith  adjustable  gain.     The  time  constant  of  the  loop  may  be 
adjusted  as  needed  by  varying  the  amplifier  gain  within  the  loop  and  by 
use  of  the  RC  filter  indicated  in  the  diagram.     Finally,  a  battery  bias  box 
is  included  at  the  varactor  input  in  order  to  operate  in  a  suitably  linear 
portion  of  the  varactor's  frequency  versus  voltage  curve.     A  ve ry  loo s e 
phase  lock  loop  is  indicated  inasmuch  as  the  voltage  varies  as  phase  (in 
short  term),   and  in  this  frequency  domain  measurement  vv^e  are  observing 
the  small  phase  variations  directly.     Philbrick  Model  P65AU  or  P25AU 
operational  amplifiers  which  are  used  are  arranged  in  a  circuit  as  shown 
in  figure  2  for  convenience  of  adjusting  the  gain  and  for  self-contained 
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FIGURE  2:  STEPPED-GAIN  OPERATIONAL  AMPLIFIER 


battery  supply  voltage.  Special  NBS  low-noise  dc  amplifiers  used  in 
certain  precision  measurements  are  shown  in  figure  3.     At  NBS  we 
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•    ■    •       ■    ,        FIGURE  3:  LOW  ilOISE  AflPLIFIER 

have  arranged  in  a  small  chassis  the  adjustable  RC  or  CR  filters 
utilizing  low-noise  components,  with  rotary  switches  for  various 
combinations  of  R  and  C  (see  fig.  4).     The  battery  bias  box  is  arranged 
with  a  vernier  as  shown  in  figure  5,   facilitating  fine  frequency  adjust- 
ments via  the  varactor  frequency  adjustment  in  one  oscillator.     A  wave 
analyzer  (Quan-Tech  Model  304)  is  used  to  obtain  the  noise  plot 
information  relevant  to  stability  (frequency  domain).     The  phase  noise 
sideband  levels  are  read  out  in  rms  volts  on  the  analyzer  set  to  certain 
chosen  values  of  frequency,   f.     This  corresponds  to  measuring  only 
those  phase  noise  sidebands  which  are  separated  from  the  carrier  by 
the  various  f  intervals  chosen.     Script  a? (f )  may  be  calculated  with  the 
assumption  that  both  sources  contribute  equally;  however,   if  one  source 
were  the  major  contributor,  then  the  noise  of  that  source  would  be  no 
worse  than  3  dB  greater  than  the  value  of  /(f)   so  calculated. 
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FIGURE  4;  ADJUSTABLE  RC  FILTER 

SI:     FILTER  MODE  SWITCH   (ROTARY,   3  WAFER) 

S2:     RESISTOR  SWITCH   (ROTARY,   SHORTING  TYPE) 

S3:     CAPACITOR  SWITCH  (ROTARY,  PROGRESSIVE  SHORTING) 
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FIGURE  5;  BATTERY  BIAS  BOX 

THE  UNITS  ARE  BUILT  ON  SEPARATE  CHASSIS  AND  CONNECTED  IN  SERIES 
TO  FACILITATE  FINE  ADJUSTMENT  BETWEEN  STEP  VOLTAGES 
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A  typical  plot  is  shown  in  figure  6.  A  sample  calculation  may  be 
found  in  Appendix  B. 
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In  figure  7  a  measurement  system  typically  used  at  NBS  for 
stability  measurements  in  the  time  domain  is  shown.     It  will  be  noted 
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FIGURE  7:  TIME  DOflAIN  nEASUREHENT  OF  FREQUENCY  STABILITY 

ITEMS   (1)   THROUGH   (8)   SAME  AS  FIGURE  1 

(9)  OPERATIONAL  AMPLIFIER,   PHILBRICK  P65AU  OR  P25AU 

(10)  STRIP   CHART  RECORDER  FOR  QUALITATIVE  OBSERVATION 
(TYPE  NOT  SPECIFIED) 

(11)  VOLTAGE-TO-FREQUENCY   CONVERTER,   VIDAR  MODEL  240 

(12)  FREQUENCY  COUNTER  WITH  LOW  DEAD  TIME,   HP  MODEL  5325B 

(13)  DIGITAL  RECORDER  WITH  FAST  RECORDING   SPEED,   HP  MODEL  5050B 
(INHIBIT  TIME  COMPATIBLE  WITH  COUNTER  DEAD  TIME) 

(14)  COMPUTER   (OPTIONAL  METHOD  OF   DATA  ANALYSIS) 

that  the  principle  of  operation  is  similar  to  that  used  in  the  frequency 
domain  measurement  wherein  the  reference  oscillator  is  locked  to  the 
test  oscillator.     However,   for  the  time  domain  measurement  we  use  a 
very  tight  phase  lock  loop  and  the  correction  voltage  at  the  oscillator 
varies  as  frequency.     This  is  a  very  convenient  setup  for  observing  fre 
quency  fluctuations  in  longer  term.     However,   with  the  time  constant 
appropriately  adjusted  and  the  means  for  taking  sufficiently  fast  sample 


15 


the  system  is  readily  used  for  short  term  measurements,  as  well  as 
the  longer  term  measurements,  in  the  time  domain.     For  qualitative 
observations  any  suitable  oscilloscope  or  strip  chart  recorder  may  be 
used.     For  quantitative  measurements  the  system  at  NBS  utilizes  a 
voltage-to-frequency  converter  (Vidar  Model  240),  a  counter  (HP 
Model  5325B),  and  printer  (HP  Model  5050B  Digital  Recorder)  capable 
of  recording  rapid  samples  of  data  with  very  short  dead  time.     The  data 
are  analyzed  typically  by  computer  via  a  program  designed  to  compute 
the  appropriate  Allan  variance   [1],  [2].     In  our  computer  program  it 
automatically  plots  on  microfilm  log  o"  versus  log   T   along  with  the 
associated  confidence  in  the  (j  .     For  small  batches  of  data  a  desk 
calculator  could  be  used  and  the  computer  analysis  would  not  be 
necessary.     An  example  of  a  specific  Allan  variance  computation  is 
shown  in  Appendix  C.     A  typical  plot  of  log  (j  versus  log   T   is  shown  in 
figure  8.     The  dashed  lines  indicate  the  slopes  which  are  characteristic 
of  the  types  of  noise  indicated. 
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FIGURE  8:    SIGMA  VERSUS  TAU 
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An  additional  useful  system  illustrated  in  figure  9  is  used  for 
differential  phase  noise  measurements  of  various  discrete  components 
which  are  frequently  used  in  stability  measurement  systems.    In  this 
system  only  one  frequency  source  is  used.    Its  output  is  split  so  that 
part  of  the  signal  passes  through  the  component  to  be  tested, 
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ITEMS   (1)   THROUGH   (14)   SAME  AS  FIGURES  1   AND  7  „..,nrn 

(15)  ANY  DEVICE  OR  COMPONENT  UPON  WHICH  NOISE  MEASUREMENTS  ARE  DESIRED 
(AMPLIFIERS,  FILTERS,   CAPACITORS,  CABLES,   PADS,  ETC.) 

(16)  NBS  ADJUSTABLE  PHASE  SHIFTER,  5MHz   (SEE  FIGURE  10) 


The  signal  is  adjusted  via  a  phase  shifter  (fig.   10)  so  that  it  is  in  phase 
quadrature  with  the  other  part  of  the  original  signal  and  is  down- 
converted  in  the  Schottky  barrier  diode  mixer  as  described  in  previous 


FIGURE  10:  ADJUSTABLE  PHASE  SHIFTER  (5MHz  DELAY  LINE) 

RG174/U  CABLE  WAS  USED  FOR  EACH  SEGMENT  OF  PHASE  SHIFT 
CALCULATED  AT  ~  1 0  cm  PER  DEGREE  AT  5  MHz. 
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systems.     A  low-pass  filter  is  included  before  the  signal  is  amplified 
in  special  low-noise,  low-level  dc  amplifiers  and  observed  on  the 
spectrum  analyzer.     Script  ^  {()   values  are  calculated  at  various  fre- 
quency values,  f,  and  plotted.     A  sample  calculation  is  shown  in 
Appendix  B. 

The  measurement  system  noise  level  (e.  g.  ,   see  fig.   6)  is  easily 
evaluated.     Using  the  differential  phase  noise  measurement  system 
shown  in  figure  9,  let  the  "device  under  test"  be  a  short  length  of 
coaxial  cable  (which  is  itself  not  a  source  of  noise).     The  small  amount 
of  noise  observed  on  the  spectrum  analyzer  represents  the  system 
noise,  mainly  due  to  the  mixer  (4)  or  the  first  amplifier  (5).  The 
calculation  of  the  system  noise  is  then  the  procedure  illustrated  in 
Appendix  B. 

By  the  phrase  very  loose  phase  lock  loop,  we  mean  that  the 
bandvi/idth  of  the  servo  response  is  small  compared  to  the  lowest  fre- 
quency f  at  which  we  wish  to  measure  (i.  e.  ,  the  response  time  is  very 
slow).     By  the  phrase  very  tight  phase  lock  loop,  we  mean  that  the 
bandwidth  of  the  servo  response  is  relatively  large  (i.  e.  ,  the  response 
time  is  much  smaller  than  the  smallest  time  interval   T   at  which  we 
wish  to  measure). 

A  convenient  chart  for  translating  between  frequency  domain  and 
time  domain  is  given  in  Appendix  D. 

Appendix  E  lists  several  important  references  for  measurement 
of  frequency  stability.    In  addition  to  several  general  references  a 
number  of  specific  papers  are  given.     These  may  be  useful  for  better 
understanding  of  the  problems  and  principles  involved  in  frequency 
stability  measurements. 

An  extensive  bibliography  is  given.     It  includes  all  references 
listed  elsewhere  in  the  paper. 
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5.    MEASUREMENTS  OF  FREQUENCY  STABILITY 
AT  MICROWAVE  FREQUENCIES 

All  of  the  systems  described  above  have  been  used  extensively 
for  determining  frequency  stability  of  1  to  100  MHz  sources.     It  is  in 
that  frequency  range,  principally,  that  the  most  stable,   spectrally  pure 
signal  sources  have  been  available.     However,  the  measurement  sys- 
tems as  described  above  are  not  limited  to  that  range.  Measurements 
can  be  performed  readily  on  sources  in  the  range  0.  2  MHz  to  500  MHz 
using  the  identical  systems  illustrated  in  figures  1  and  7.     (For  the 
system  in  fig.  9  the  only  component  which  would  be  different  is  the 
phase  shifter  which  must  be  one  capable  of  functioning  at  the  source 
frequency.  )    Similar  measurement  systems  can  be  used  in  frequency 
ranges  up  to  12  GHz  without  employing  waveguide  mixers  or  other 
waveguide  components.     A  wider  range  mixer  (instead  of  the  one 
specified)  must  be  substituted  and  possibly  some  isolation  of  the  sources 
would  be  needed.     Several  commercial  double -balanced  mixers  with 
coaxial  connectors  are  available  using  Schottky  barrier  diodes  [9]. 
The  techniques  of  measurement  are  basically  the  same  as  described 
previously.     In  general,  waveguide  components  may  be  used  for  these 
frequency  stability  or  phase  noise  measurements  between  5  GHz  and 
12.4  GHz  (and  higher).     Balanced  mixers  can  be  made  using  a  180° 
hybrid  (magic  tee)  as  the  coupling,  device  with  two  diodes  mounted  either 
in  series  or  in  shunt  with  the  output.     Our  interest  (or  experience)  in 
this  frequency  range  has  not  been  extensive  partly  because  of  the  lack  of 
spectrally  pure  sources  at  higher  frequencies.     However,  the  measure- 
ments which  have  been  made  employ  the  previously  described  techniques 
primarily. 
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The  results  of  our  measurements  indicate  that  the  precision 
capabilities  are  better  than  what  is  necessary  for  determining  stability 
on  the  relatively  noisy  sources  available  (i.e.  ,  klystrons,  Gunn  oscil- 
lators,  sources  derived  from  lower  frequency  by  multiplication,  etc.  ). 

i  ■  . 

6.  SUMMARY 

Concise  definitions  for  specifying  frequency  stability  have  been 
given  for  measurements  in  the  frequency  domain  and  time  domain. 
The  attempt  is  to  be  basic  so  that  a  person  without  extensive  knowledge 
in  the  field  can  quickly  grasp  the  concepts  involved  (extended  deriva- 
tions and  theory  are  left  to  the  appendices  or  references).  Several 
contemporary  measurement  techniques  are  reviewed  and  compared. 
Operational  systems  for  measurement  of  frequency  stability  are 
described  in  detail  sufficient  to  facilitate  duplication  of  the  apparatus 
used.    Uniform  methods  of  reporting  data  and  techniques  of  measure- 
ment are  recommended  as  advantageous  and  desirable  so  that  better 
interpretation  of  specifications  for  frequency  stability  can  be 
accomplished.    The  measurement  systems  and  techniques  may  be 
utilized  well  into  the  microwave  region. 

The  author  is  particularly  indebted  to  Dr.  Donald  Halford  for  his 
valuable  assistance  and  comments  in  the  preparation  of  this  document. 
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APPENDIX  A 
Glossary  of  Symbols 
Carrier  frequency 
Fourier  frequency  of  fluctuations 
Nominal  frequency  of  source 
Frequency  fluctuation 
Fractional  frequency  fluctuations, 

dx 

Time  interval  fluctuations,  — —  r  y 

dt  ^ 

Average  of  y  over  a  time  interval  T 

Defined  as  B,  high  frequency  cutoff  (bandwidth) 

Spectral  density  of  y 

Radio  frequency  power  spectral  density 
Phase  fluctuation 

2 

Spectral  density  of  phase  fluctuations;   S.   (f)  =  S  (f)  — — 

b<t>  y 

Frequency  domain  measure  of  phase  fluctuations; 

Script      (f )  is  defined  as  the  ratio  of 

Power  density  (one  phase  modulation  sideband) 
Power  (total  signal) 

For  small    6^,  S     {{)  =  2j^(f) 
6® 

Number  of  data  values  used  in  obtaining  a  sample  variance 

Total  number  of  data  values  available  (usually  M  »  N) 

Time  interval  between  the  beginnings  of  two  successive 
measurements 
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APPENDIX  A  cont. 

T  Sampling  time  interval 

r  Parameter  related  to  dead  time;   r  =  T/t 

t  Time  variable 

Cj-^(N,  T,  t)    Sample  variance  of  N  averages  of  y(t)  each  of  duration  T, 
and  repeated  every  T  units  of  time  (Allan  variance) 

k,n  Integers  (used  as  index  of  summation) 

2 

(T   (t)  Specific  Allan  variance  where  N  =  2,  T  =  T 

y 

(J  Square  root  of  a  variance 

A  Peak-to-peak  voltage  of  a  beat  frequency  at  output  of  mixer 

V  Root-mean- square  (noise)  voltage  at  output  of  mixer  as 

measured  by  a  spectrum  analyzer 
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APPENDIX  B 


A  Sample  Calculation  of  Script  af 

For  convenience  of  computation  and  plotting  it  often  is 

advantageous  to  set  the  beat  frequency  voltage  (before  locking)  to 

— X=r=r  volts  (0.  316  V)  peak-to-peak  at  the  mixer  output.    Then  (after 
v/10 

lock)  with  the  output  of  the  phase  detector  expressed  in  rms  nanovolts 
per  root  hertz,  direct  plotting  is  facilitated  for  j£(f)  in  decibels  versus 
frequency  in  hertz.    In  this  case  1000,    100,  and  10  nanovolts  per  root 
hertz  correspond  to  -110,   -130,  and  -150  dB  respectively.     A  sample 
calculation  demonstrating  this  convenience  is  shown  below. 
Given: 

A'        =   0.  316  V  (i.  e.  ,  V) 
ptp  710 


v         =    lOOnVHz"'^    @    f  =  20  Hz 
rms 


100nVHz"'^\        /   lO'""  \        -1      10"^'',,  -1 

Hz     =   Hz 


0.  316  V        '  \  rrr^  J  ,n-i 


10'^^  Hz"^  =    -130  dB 


or  u^ing  logarithms: 


'^rms\  ,  (10-''  V-  Hz'  ''^) 


^'ZQ  Hz)  =  20  log   =  20  log      ^  -j^   =  20(-7  +  C.5) 


3-130  dB 

If  the  phase  noise  follows  flicker  law,  at  f  =  1  Hz  it  is  20  times  worse 
(or  13  dB  greater),  that  is 

af(l  Hz)  =    -130  dB  +  13  dB  =  -117  dB. 
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APPENDIX  C 


A  Sample  Calculation  of  Allan  Variance,  cr  (t) 

   y   


ay(T) 


(a^{N=  2,T=  T,T))=  (^^^ 


1 


M-l 


2(M-  1) 


1  'V 


k+1  "  '^k 


k=l 


in  the  example  below: 

Number  of  data  values  available,  M  =  9 
Number  of  differences  averaged,  M  -  1  =  8 
Sampling  time  interval  T  =  Is 


Data  values 

(y) 

892 
809 
823 
798 
671 
644 
883 
903 
677 


First  differences 


83 

14 

25 
127 

27 
239 

20 
226 

M-l 


1 

k=l 


(y 


k+l 


First  differences  squared 


6889 
196 
625 

16129 
729 

57121 
400 

51076 

h3165 


Based  on  these  data: 


a^(T) 
y 


133165 
2(8) 


=:  8322.81, 


[%(T)] 


y  8322.  81    =   91.  23,  N  =  2,  T  =  T  =  1 


In  this  example,  the  data  values  may  be  understood  to  be  expressed  in 
parts  in  10  ^  ^. 
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APPENDIX  Ccont . 


Using  the  same  data  as  in  the  above  example  it  is  possible  to  calculate 
the  Allan  variance  for   T  =  2s  by  averaging  pairs  of  adjacent  data  values 
and  using  these  averaged  values  as  new  data  values  to  proceed  with  the 
calculation  as  before.    Allan  variance  values  may  be  obtained  for 
T  =  3  s  by  averaging  three  adjacent  data  values  in  a  similar  manner, 
etc.  ,  for  larger  values  of  T. 

Ideally  the  calculation  is  done  via  a  computer  and  a  large 
number,  M,  of  data  values  should  be  used.     (Typically  M  =  256  data 
values  are  used  in  the  NBS  computer  program.  )    The  statistical  confi- 
dence of  the  calculated  Allan  variance  improves  nominally  as  the  square 
root  of  the  number,  M,  of  data  values  used.     For  M  -  256,  the  confi- 
dence of  the  Allan  variance  is  not  expected  to  be  better  than  approxi- 
mately    — / ^         X  100%  ^    7%     in  the  rms  sense.    The  use  of  M  1 
/256 

is  logically  similar  to  the  use  of   B    •  T    »  1  in  spectrum  analysis 

a  a 

measurements,  where  B     is  the  analysis  bandwidth  (frequency  window) 
of  the  spectrum  analyzer,  and  T     is  the  post-detection  averaging  time"^ 
of  the  spectrum  analyzer. 
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APPENDIX  E 

Some  Important  References 
for 

Measurement  and  Specification  of  Frequency  Stability 
General  References 


1.  November  or  December  of  even-numbered  years  IEEE 
Transactions  on  Instrumentation  and  Measurement  (Conference 

on  Precision  Electromagnetic  Measurements,  held  every  2  years). 

2.  February  1966  Proceedings  of  the  IEEE,   special  issue  on 
frequency  stability  (IEEE-NASA  Symposium). 


3.      Proceedings  of  the  IEEE-NASA  Symposium  on  the  Definition 
and  Measurement  of  Short-Term  Frequency  Stability  at 
Goddard  Space  Flight  Center,   Greenbelt,  Maryland, 
November  23-24,   1964.    Prepared  by  Goddard  Space  Flight 
Center  (Scientific  &  Technical  Information  Division,  National 
Aeronautics  and  Space  Administration,  Washington,  D,  C.  , 
1965).    Copies  available  for  $1.75  from  the  U.  S.  Government 
Printing  Office,   Washington,  D.C.  20402. 


4.      The  annual  proceedings  of  the  Symposium  on  Frequency  Control 
(Ft.  Monmouth).     These  papers  are  not  edited  nor  reviewed. 


J.   A.   Barnes,   A.  R.   Chi,   L.  S.  Cutler,   et  al.  ,  "Characterization 
of  Frequency  Stability,  "  NBS  Technical  Note  394  (October  .970); 
also  published  in  IEEE  Trans,  on  Instr.  and  Meas.  IM-20,  No.  2, 
pp.   105-120  (May  1971).    This  is  the  most  definitive  discussion 
to  date  of  the  characterization  and  measurement  of  frequency 
stability.    It  was  prepared  by  the  Subcommittee  on  Frequency 
Stability  of  the  Institute  of  Electrical  and  Electronic  Engineers. 
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APPENDIX  E  cont. 


Some  Specific  Papers 

6.  D.  W.  Allan,   "Statistics  of  Atomic  Frequency  Standards,  " 
Proc.  IEEE,  vol.  54,    pp.  221-230,  February  1966. 

A  thorough  understanding  of  this  paper  is  important  for 
everyone  who  wishes  to  measure  and  quote  performance  of 
frequency  standards  in  the  time  domain,   e.  g.  ,  cr  versus  T 
plots.    The  data  analysis  must  take  into  account  the  number 
of  samples  taken  and  how  they  are  used. 

7.  David  W.  Allan,  B.  E.  Blair,  D.  D.   Davis,  and  H.  E. 
Machlan,  "Precision  and  Accuracy  of  Remote  Synchroniza- 
tion via  Portable  Clocks,  Loran  C,  and  Network  Television 
Broadcasts,  "  Proc.   25th  Annual  Symposium  on  Frequency 
Control,   Fort  Monmouth,  N.  J.  ,   2 6- 28  April  197  1 ,  to  be 
published. 

8.  E.  J.   Baghdady,  R.  N.   Lincoln,  and  B.  D.  Nelin,  "Short- 
Term  Frequency  Stability:  Characterization,   Theory,  and 
Measurement,  "  Proc.  IEEE,  vol.  53,  pp.  704-722,  July 
19  65.    Among  many  other  topics,  the  possible  problem  of 
AM  noise  is  discussed. 

9.  Helmut  Brandenberger ,  Frederic  Hadorn,   Donald  Halford, 
and  John  H.  Shoaf,   "High   Quality  Quartz  Crystal  Oscillator 
Frequency  Domain  and  Time  Domain  Stability,  "  Proc.  25th 
Annual  Symposium  on  Frequency  Control,   Fort  Monmouth, 
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